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ini  i  nduction 


The  linear  programs  considered  here  are  of  the  form: 


Maximize  (c,x) 


(LP) 


subject  to 


a  =  A  x  r  b 


where  A  is  of  full  row  rank,  and  (LP)  is  feasiWo  with  bounded  optimal  solu¬ 
tions. 

The  main  result,  equation  (24),  is  an  explicit  representation  of  the 
general  optimal  solution  of  (LP),  in  terms  of  a  generalized  inverse  of  . 
This  explicit  solution  of  (LP)  -explicit  in  the  sense  that  A ~H>  is  an 
explicit  solution  of  Ax  =  b  -  has  obvious  theoretical  (and  possibly  computa¬ 
tional)  advantages  over  the  well  known  iterative  methods  of  linear 
programming,  e.  g.  [5]  ,  [8]. 

The  results  are  illustrated  by  a  simple  example,  and  extensions  to 
general  linear  programs  arc  discussed. 

Preliminaries  and  notations 
We  denote  by: 

Rn  the  n-dimensional  real  vector  space 
For  any  two  vectors  x,y  in  Rn; 
x  ~y  denotes  x^  £  y .  (i  =  l, . . .  ,  n) 


For  other  applications  of  generalized  inverses  in  linear  programming 
see  [14]  ,  [7]  and  [6]  . 
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For  any  subspace  L  of  Rn: 

L  1  denotes  the  orthogonal  complement  of  L 
PT  denotes  the  perpendicular  projection  on  L 

Li 

For  any  mxn  real  matrix  A: 

T 

A  --  the  transpose  of  A 
R(A)  --  the  range  space  of  A 
N(A)  --  the  null  space  of  A. 

For  the  fixed  mxn  real  matrix  A  consider  the  4  matrix  equations 


(l) 

AXA  =  A 

(2) 

XAX  =  X 

(3) 

(AX)T=  AX 

(4) 

(XA)T=  xa 

W  e  denote  by  A  f  i,  j, .  .  .  ,  k}  the  set  of  nxm  real  matrices  X 
satisfying  equations  (i),  (j), .  .  .  ,  (k),  (1  £  i,  j, . . .  ,  k  £  4)  .  These  sets 
A  {  i,  j, .  .  .  ,  k]  ,  ( 1  £  i,  j, .  . .  ,  k  £  4),  are  nonempty  because  A  { 1,  2,  3,  4}  is 
nonempty,  e.  g.  [13]. 

A  matrix  X  e  A  {  i,  j, .  .  .  ,  k]  is  called  an  f  i,  j,  .  .  .  ,  k]  -  g.  i. 
(generalized  inverse)  of  A.  The  [1,2, 3, 4}  -  g.  i.  of  A  is  unique,  and 

is  the  wei.1  known  Moore- Penrose  generalized  inverse  ,  e.  g.  [  13]  ,  [  12]  , 
denoted  by  A+  ,  For  some  applications  a  weaker  g.  i.  will  do,  e.  g. 

[  3]  ,  [4]  ,  [  ll]  and  [10]  .  Thus  for  solving  linear  equations  (and  for 
the  purpose  of  this  paper)  [  l]  -  g.  i's  are  sufficient,  as  shown  by  the 
following: 

Lemma  1  ([  3 ]  ,  [  13 ]  ):  The  linear  equations 

(5)  A  x  =  b 

are  solvable  iff  for  any  TeA  [  1} 


X 


-3- 


(6) 


ATb  =  b  , 


JJLwhich_ca sje  the^eneral  solution  of  (5)  is: 


□ 


<7)  «»Tb+  (I  -  TA)y  .  y  arbitrary 

Th=  Afl}  is  represented  in  terms  of  one  of  its  elements  as  follows: 
emma  2  (  [  3])  :  .Let  R  be  any  f  lj  -  g.  i.  of  A.  Then 


(8) 


Afl}  =  fRAR  +  Y  -  RAYAR  :  Y  arbit 


rary 


Projections  associated  with  g.  i's  are  given  in: 
Lemma  3  ([  1]  )  : 


nxm  real  matrix  } 

a 


^  .  S  e  A  f  1 ,  3  }  then 


(9) 


AS  = 


p 

R(A) 


(b)  If  T  e  A  f  1,2,4}  then 


(10) 


TA  =  P 

R(A  j 


A  recipe 
N(A)  is  given  in: 
Lemma  4:  Let  A 
nonsingular  mxm 


for  computing  afl}  -  g.  i.  and  for  constructing  a  basis  of 

—  an-  mxn  I£al  matrix  of  rank  r  ,  and  let  E  be  a 
real  matrix  such  that: 
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(11) 


EA  = 


(m-  r)xn 


where  P  is  a  permutation  matrix. 
Conclusions: 


P 


(a)  Let  E  be  partitioned 


(12) 


then  the  nxm  matrix 


E  =  l  — 


11 

■K  *  - 
l21 


'12 
"T"  "" 

'22  /  where  E^  is_  rxr 


(13) 


T  =  P 


E  i  E 

.-l_l-.l__._L2. 

°(n-  r)  x  m 


is  a  f  l,  2}  -  inverse  of  A 


(b)  The  columns  of  the  nx(n-r)  matrix 


(14) 

form  a  basis  of  N(A)  . 
Proof: 


N  =  P 


T  /  -  A 


I 


n-r 


(a)  Consider  the  nxn  nonsingular  matrix 


(15) 


F  =  P 


T  r 


-A 


n-r 


From  (11),  (15)  and  PP  =  I  we  get 


EAF  = 


I  . 
__r  j_  0_ 

oTo 


or 
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(16) 

Now  the  matrix 


A  =  E" 


K\° 

6  I  o 


T  =  F 


o :  o 


18  a  f  1,2}  -  g.  i.  Of  A,  as  shown  by  substituting  (16)  and  (17)  in  (1)  and  (2) 
Substituting  (12)  and  (15)  in  (17)  we  get 


T  =  P' 


1  !  A 

_  _r 

”6"  IT"' 


6  ;  o 


.rJ.o 
o  1  o 


which  proves  (13)  . 


E  1 

11  ! 

..f.12  ) 

E2l  ! 

i 

E22  / 

(b)  Obvious  from  (11)  and  the  facts  :  PPT  =  I  and  E  nonsingular.  □ 

For  other  results  and  references  on  f  1}  -  g.  i»8  see  [4]  ,  [10] 


and  [  1]  . 


(LP) 


Results; 

Consider  the  linear  programming  problem: 
Maximize  (c,x) 
subject  to 


(18) 

for  given 

and  assume: 


a-Ax:b, 


A  =  (aij)  »  a  =  (a.)  ,  b  =(b.)f  c  =  (c^.) 

(i  =  1, . . .  ,  m  ;  j  =  1, . . .  ,  n)  , 
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Assumption  1:  (LP)  is  feasible,  i.  e. 

(19)  S  =  { x  e  Rn  :  a  :  A  x  r  b  }  /  0 
The  following  properties  of  S  are  obvious: 

Lemma  5:  Jf_(l9)  then 

(20)  S  =  S  +  N(A)  =  {x  +  y  :  x  e  S,  ye  N(A)} 
and  the  set 


(21)  P  T  S  =  (P  _x:xcS)  is  bounded. 

R(AA)  R(AL) 

The  case  when  (LP)  has  a  finite  maximum  is  characterized  in 
Lemma  6:  (LP)  has  a  bounded  optimal  solution  iff 

(22)  c  i  N(A) 

Proof;  If_:  From  (22)  and  the  fact 

N(A )  =  R(AT)i 

it  follow  8  that 


f  (c,x)  :  xe  S)  =  f  (c, x)  :  x  e  P 


T  S) 
R(A  ) 


and  is  a  bounded  interval,  since  (21)  is  a  bounded  set. 
Only  if:  Suppose  P^^  c  /  0  .  Then  the  interval 


{  (c,  x)  :  xe  S} 

is  the  entire  real  line,  by  (20) 

We  make  now  2  additional  assumptions: 


% 
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A  ssumption  2:  (LP)  has  a  bounded  optimal  solution,  i.  e.  (22 )  holds. 

A  s  sumption  3:  The  matrix  A  is  of  full  row  rank: 

(23)  rank  A  =  m 

An  explicit  representation  of  the  general  optimal  solution  of  (LP)  is  now  given: 
Theorem:  Let  (LP)  satisfy  assumptions  1,2  and  3,  and  let  the  nxm  matrix 
T  with  columns  (t.,  t„, .  . .  ,  t  )  be  a  f  1}  -  g.  i.  of  A .  Then  the  optimal 

-  l  ^  m  — —  "  ■  ■  . 

solutions  of  (LP)  form  the  manifold: 

(24)  x  -  E  t.a.  +  E  t.b.  +  E  t.  (S.b.  +  (l  -  0.)a.)  +  N(A) 

.„T  1  1  .  T  1  1  .  T  1  '  1  1  '  11 
1C  I  1C  I,  l€lrt 

-  +  u 

where 

I_  =  {i  :  (c,t.)  <  0  } 

(25)  I+  =  (i  :  <c,t.)  >0  } 

IQ=  [  i  :  (c,  t.)  =■  0  } 
and  0  i  0.  S  1  ,  i  e  IQ  . 

Proof:  From  (23)  it  follows  that 

R(A)  =  Rm 

so  that  for  any  z  in  Rm  we  have 

(26)  z  =  A  x 
where 

(27)  x  =  T  z  +  N(A)  ,  by  lemma  l. 

Substituting  (26),  (27)  in  (LP)  we  conclude  from  (22)  that  (LP)  is 
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equivalent  to  the  following  linear  program  over  a  parallelopiped: 


(LPP) 


Maximize  (c,  T  z  ) 
subject  to 


a  $  z  S  b 


whose  optimal  solution  is  obviously: 


z.  ={  b. 

i  I  i 


for  any 


G.b.  +  (1  -  e.)a. 

ii  i  i 


0  S  fl,  S  1 


iel0  . 


From  (27)  and  (29)  it  follows  that  the  manifold  (24)  is  the  set  of 


optimal  solutions  of  (LP). 

Remark:  Ic  can  be  shown  directly  that  the  set  (24)  is  independent  of  the 
particular  {  l)  -  g.  i.  used  in  its  definition.  We  need: 

Lemma  7:  Let  A  be  an  mxn  matrix  of  rank  m  ,  and  let  T  be  any 
{  1}  -  g.  i.  _of  A.  Then 


(30)  T  =  A  r  W 

where  W  is  a  matrix  whose  columns  lie  in  N(A)  . 

Proof:  Lemma  2,  with  R  =  A+  ,  the  unique  { 1,  2,  3, 4}  -  g.  i.  of  A ,  gives: 


(31)  A  {  1}  =  A+AA+  +  Y  -  A+A YAA+  ,  Y  arbitrary 


=  A  +  P 


N(A) 


Y  ,  Y  arbitrary 
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This  follows  from  A+AA  +  =  A  +  by  (2)  , 


AA  =  PR (A )  *  ^  M  ' 

=  I  ,  since  rank  A  =  m 

and  I  -  A+A  =  I  -  P  ,  by  (10)  , 

RfA1) 

=  pn(a)  * 

Now  (30)  follows  from  (31)  with  W  =  Pxt/A  v  .  n 

N(A)  □ 

From  lemma  7  and  (22)  it  follows  that  the  sets  I  ,  I+,  1^  defined 
by  (25)  and  the  general  solution  (24)  are  independent  of  the  f  1}  -  g.  i.  used 
in  the  theorem. 


Example; 


The  problem,  of  class  (LP)  ,  is: 


(32) 


Maximize  2x.  -  x_  -  x,  +  3x„ 
12  3  4 

subject  to: 

0  5  X1  +  2x2  -  x3 


3  <  -x. 


+  x. 


l  5  2x.  +  x,  ■  3x,  +  x . 
12  3  4 


<  l 

<  0 
S  3 


V/e  use  lemma  4  to  compute  a  {1}  -  g.  i.  of 


1 

A  =  |  -l 

2 


2 

0 

1 


-1 

l 

-3 


0 

-l 

1 


by  diagonalizing  the  m  x  (n  +  m)  matrix 


A(0)  =  (A  .  I  )  : 

m 


0  2-10  100 

-101-1  01  0 

2  1-31  001 


pivots  are 
circled 


12-10  100 

0(2)  o-i  i  l  o 

0  -3  -l  1  -2  0  1 


(2)  _ 


(3)  _ 


10-11  0  -5/2-1 

0  l  0  -1/2  1/2  l/2  0 

0  0  0-1/2  -1/2 -3/2-1 

1  0  0  3/2  1/2  -5/2-1 

0  1  0  -l/2  1/2  l/2  0 
0  0  1  1/2  1/2 -3/2-1 


Assumption  3  is  satisfied  if  the  last  matrix  A'  is  of  the  form 


A  =  (dm.  MP|E) 


Indeed  from  A'  '  we  read 


(  (  1/2  -5/2  -1 

e>=  -1/2  .  p  =  i  .  1/2  1/2  0 

\  1/2  /  \  1/2  -3/2  -1 


and  by  (14)  it  follows  that  N(A)  is  spanned  by  the  vector 


(34)  N  =  ( 

U7 

and  that  assumption  2  is  satisfied  for  c  = 


From  (13)  and  (33)  we  get  a  { 1}  -  g.  i.  of  A: 


-5/2 

V} 

-3/2 

0 


(35) 


for  which 
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/  1/2 

-5/2 

-A 

=  (2,-1,  -1, 3) 

'  1/2 

1/2 

0 1 

1  1/2 

-3/2 

-* 

\  0 

0 

o  / 

=  (0,  -4,  -1) 


so  that 


(36)  I_  =  {2,3}  ,  I+  =  /  ,  IQ  =  {1}  . 

The  general  optimal  solution  of  (32)  is  from  (24),  (34),  (35)  and 

(36): 


with  0  i  0^  S  1 

and  X.  arbitrary  , 


The  optimal  value  of  (c,x)  =  U. 

A  different  choice  of  pivots  in  A  ^  (i  =  0,1,2)  could  result  in 
different  matrices  in  (33)  and  (35),  but  the  sets  (36)  and  the  manifold  (37) 
are  unchanged. 

Discussion 

Linear  programs  arising  in  concrete  applications  are  usually 
feasible  and  possess  bounded  optimal  solutions.  Therefore  assumptions 
l  and  2  are  not  too  restrictive. 

Also  any  linear  program  with  inequality  constraints  can  be 
rewritten  as  our  problem  (LP),  by  setting  the  missing  :  a^  and  b.  as: 

-M  and  +M  respectively,  where  M  >  0  is  a  sufficiently  large  number. 
(If  M  appears  in  an  optimal  solution,  then  the  problem  has  unbounded 
optimal  solutions). 
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The  remaining  assumption  3  is  a  true  restriction  on  the  scope 
of  our  method.  It  is  typically  violated  by  linear  programs  of  the  form: 

Maximize  (c,x) 
subject  to 


(38)  Ax  <b 

x  ?  0 

which  are  rewritten  as  our  (LP)  : 

Maximize  (c,x) 


(39) 


where  M  >  0  is  sufficiently  large,  and  e  = 


There  are  several  ways  of  applying  om  method  to  problems  (J-P) 
without  assuming  A  to  have  full  row  rank.  One  possibility  is  to  partition 
(LP)  as  follows: 


Max  (c,x) 


(40) 

where  A^  is  an 


1  <  .1  <  .  I 

a  S  A  x  =  b 

2  <  s2  <  ,2 

a  5  A  x  =  b 


rxn  submatrix  of  the  mxn  matrix  A  and 


(41) 


rank  A  *  =  rank  A  =  r  . 
From  (41)  it  follows  that 


(42)  N(A)  =  N(Al) 

and  by  lemma  6,  problem  (40)  has  a  bounded  optimal  solution  iff 


The  subproblem 


(44) 


Max  (c,x) 
a  ^  %  A^x  ^  b^ 


thus  satisfies  our  assumptions,  and  (24)  can  be  used  to  obtain  the  manifold 


(45)  xl  +  N(A) 

of  optimal  solutions  of  (44). 

Any  vector  in  (45)  which  satisfies  the  remaining  constraints 
a  £  A  x  =  b 

of  (40)  is  clearly  an  optimal  solution  of  (40).  In  the  absence  of  such  a  vector, 
an  optimal  solution  of  (40)  can  be  found  in  a  finite  number  of  iterations,  where 
at  each  iteration  A1  is  changed  by  one  row  in  an  obvious  manner.  Our 
method  may  thus  serve  as  a  start  for  a  dual  simplex  method. 

Another  possibility  is  to  partition  (LP)  into  k  subproblems 
Max  (cjX1) 


(46.  i)  a*  ^  A*x*  ^  b*  (i  =  l, . . .  ,  k) 

where  each  subproblem  satisfies  our  assumptions  1  and  3  .  Since 
assumption  2  is  assumed  for  (LP)  ,  we  solve  (46.  i)  by  (24)  as  if 
c  i.  N(A*)  ,  i  -  l, . .  .  ,  k.  The  resulting  optimal  solutions  are  generally 
different,  but  may  be  forced  to  coincide  in  a  finite  number  of  iterations  of 
the  decomposition  method  of  Dantzig- Wolfe  [  9]  .  These  results  are 
contained  in  [  15]  . 
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The  linear  programs  considered  here  are  of  the  form: 


Maximize  (c,x) 


(LP) 


subject  to 


a  =  A  x  5  b 


where  A  is  of  full  row  rank,  and  (LP)  is  feasible  with  bounded  optimal 
solutions. 


The  main  result,  equation  (24),  is  an  explicit  representation  of  the 

general  optimal  solution  of  (LP),  in  terms  of  a  generalized  inverse  of  A.  This 

explicit  solution  of  (LP)  -  explicit  in  the  sense  that  A  b  is  ar  explicit  solution 
of  A  x  =  b  -  has  obvious  theoretical  (and  possibly  computational)  advantages  ove 
the  well  known  iterative  methods  of  linear  programming. 

The  results  are  illustrated  by  a  simple  example,  and  extensions  to 
general  linear  programs  are  discussed. 
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